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Abstract 

1> 

I The paper analyses stochastic systems describing reacting molecular systems 

with a combination of two types of state spaces, a finite-dimensional, and an in- 
finite dimenional part. As a typical situation consider the interaction of larger 
macro- molecules, finite and small in numbers per cell (like protein complexes), with 

I"" ' smaller, very abundant molecules, for example metabolites. We study the construc- 

tion of the continuum approximation of the associated Master Equation (ME) by 
using the Trotter approximation [27 . The continuum limit shows regimes where 
• the finite degrees of freedom evolve faster than the infinite ones. Then we develop 

. a rigourous asymptotic adiabatic theory upon the condition that the jump process 

arising from the finite degrees of freedom of the Markov Chain (MC, typically de- 
scribing conformational changes of the macro-molecules) occurs with large frequency. 

I— ' In a second part of this work, the theory is applied to derive typical enzyme kinetics 

in an alternative way and interpretation within this framework. 

> 

I/-) 1 Introduction 

(N 

Think of a typical situation in Cell Biology, the interaction of macro-molecules in the 
CN cell. In most cases there will be a small number of macro- molecular machines, like 

O i„„..,^„els. ,o.„. .W.nes e.c^ wMO, «e essential fo. ceU.l„ tac- 

tion, but which will not be very abundant in numbers per cell. Moreover this number 
will typically not change over time of observation. These machines will have different 
states of operation, like an ion channel can be closed or open. The states of operation 
of such machines can in general be described by finitely many different discrete states. 
These discrete states can be associated with meta-stable conformations of proteins (see 
for example [H]). Smaller molecules like ions, or metabolites like sugars, will interact 
with these macro-molecules. The most typical and best studied situation are enzymes 
catalysing metabolic reactions. The classical way to describe the resulting kinetics is 
given in [23] , see also [25] . The number of these smaller molecules clustered in different 
species will change typically over time of observation. Assuming no inherent spatial 
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structure of the process, this gives rise to coupled systems of two weh studied mathe- 
matical objects, Markov chains describing the transitions between the different modes 
of operation of the macro- molecules, and birth-death processes with reactions describing 
the change in numbers of the smaller abundant molecules. In this paper we will study 
both mathematical objects simultaneously as one system, giving a rigourous derivation 
of the continuum limit. With other interpretations the theory can also applied in various 
other fields of sciences where interaction of different finite state 'machines' will occur, 
like epidemiology, manufacturing or economy. 




Figure 1: Different typical interactions of small and large molecules in a typical cell. (A): 
Interaction of enzymes with metabolites. The product is a molecule consisting of two elementary 
species. Enzymes react as catalysators. (B): Genetic interactions. For example a repressor can 
bind to the DNA only in the case it is in a conformation characterised by the absence of smaller 
'inducing' molecules. (C): Membrane proteins act in various ways as molecular machines, for 
example as ion channels. 

As a concrete example from Genetics assume mRNA is transcribed depending on 
whether a specific DNA binding site is bound to a transcription factor A. There are 
two possible limit regimes: either no A molecules are binding causing no mRNA tran- 
scription, or molecules A are binding to the DNA implying a maximum transcription 
rate for the mRNA. Usually such binding/unbinding events occur at large frequencies, 
and they are proportional to the concentration of the transcription factor. This leads to 
an effective transcription rate resulting from an "effective average" of the binding/un- 
buinding event depending on the concentration of A. This effect is usually modelled by 
a Hill- type kinetics ( |3] ) : 



K{[A]) 



Ki [AY 



1 + K2 [A]^ 

This kinetics describes an effective reaction rate with saturation behaviour for large 
concentrations [A] of the transcription factor A. Here n is a positive integer, an exponent 
controlling the slope of the sigmoidal i^([j4]). In this paper we consider as an illustrative 
example the case n = 1, in [23] we shall describe the general case. We will follow this 
particular example throughout this paper (part I) starting from microscopic assumptions, 
and derive the above deterministic limit in part II. 
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Birth-death processes and the density assumption 

We will assume that at time t the state of the subsystem describing small molecules 
of variable number is fully determined by the collection of these numbers belonging to 
different species. The time evolution is given through the transition from one possible 
collection of these molecules to another. The transition itself is prescribed by the reac- 
tions, which contain the rates at which the various species form complexes, i.e. other 
species. Reactions define the dynamics by providing the probability rates at which the 
elementary transitions occur, and this leads to constructing a stochastic process with 
independent increments (Markov property). For this part of the system the state at time 
t is described by a probability distribution, which solves the so-called Master Equation 
(ME) (see for example [28^ and |15]). The ME is a differential equation with respect to 
time and a difference equation with respect to the various particle numbers. In many 
situations the number of molecules involved is of the order of the Avogadro number 
~ 10^^, which implies that the concept of density can be introduced. That can be 
achieved by constructing the so-called continuum approximation of the ME, an opera- 
tion that transforms the ME into a Fokker-Planck Equation (FPE). This correspondence 
is a very delicate point and often neglected in applications. Usually the continuum ap- 
proximation is investigated through the Kramers- Moyal expansion or the Van Kampen 
size-expansion [15] , f2BJ . Here we employ the Trotter approximation |27| ITU [T9] to study 
multi-scale reactions systems. In fact the stochastic process generated by the FPE is a 
valid approximation to the one generated by the ME only for a fixed time interval (for 
further details see [8], [H],[l0], and [16^ for a recent review). A representation of the ME 
can be directly studied numerically through Gillespie's algorithm (see |1J) which pro- 
vides the construction of the underlying stochastic process. Our focus as outlined in the 
reminder of this introduction aims at understanding how different scales are affecting 
the macroscopic dynamics. These are the ingredients of models usually of interest in 
Mathematical Biology or Systems Biology. 

Molecular subsystems with finite degrees of freedom, mixed systems 

To summarise the system to study will have two kind of state variables (degrees of 
freedom), first variables which admit a continuum approximation as just described, and 
secondly variables whose discrete nature is essential. Earlier work to study such sys- 
tems include |6] and |T3]. In this class the state is described by a set of numbers of 
molecules, and a set of finite discrete states describing all possible molecular conforma- 
tions, binding/unbinding events, etc. The dynamics is described by a master equation 
and its solution, a probability distribution generating a Markov process. After taking 
the continuum approximation it has been formally shown in an appendix of p] that the 
whole process is a combination of a continuous process and a discrete Markov chain 
with finite states. Such systems are sometimes also called random evolutions [5 . They 
are ubiquitous in the realm of complex systems. It may happen that infinite and finite 
degrees of freedom evolve on different time scales. Indeed in many applications like p] it 
appears that the dynamics associated to the finite degrees of freedom evolves very fast. 
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and therefore it is important to understand how this affects the dynamics associated to 
the infinite degrees of freedom. Heuristicahy this is usually done by introducing ad hoc 
reaction rates (see |3j ) , which mimic some sort of " averaged effect" . 

Some remarks on this previous work. In [6' such systems are studied by using the 
ME method and by taking a heuristic continuum approximation. Subsequently formal 
asymptotic methods are applied to study the large frequency problem. In the context of 
simulation the analysis of systems with fast and slow dynamics has been addressed in 
[20] . where the updates of the infinite state variables was optimised. Collective effects of 
many particles in biological systems have also been investigated in [13j where a many- 
particle method is used. This approach has its origins in multi-body and field theory, (see 
|2] ) . Inspired by the approach presented in an appendix of [6] we develop in this paper a 
rigourous analysis of the adiabatic theory for systems with infinite and finite degrees of 
freedoms. The paper presents a general formulation for the ME for such systems whose 
state space is formed by types of particles and g finite states. Let S be the set of 
all possible discrete states. At time t the system is in a state (n,a) e x S with 
probability -P(T(n, t). The A^-tuple n = (ni, n^v) G N''^ represents the collection of free 
molecules of different species, and cr is a discrete state in S describing the conformational 
changes of macro-molecules which number does not change during system observation. 
The ME for the probability Ps{n,t) is then given by 



where C*{n) is a collection of difference operators (the '*' indicating the adjoint of 
an operator, a notation which will become clear later in the paper) and /C"^(n) is the 
transpose of a generator of a Markov chain on S. We will study the ME with two 
methods, the continuum limit and the adiabatic approximation. 

The continuum limit 

The continuum limit will be formulated by using the so-called Trotter approximation 
(see [27], [I9]). Trotter's method has been also used in [HI 13 [TO]. The equation ([TJ 
is derived on the base of the elementary molecular processes that depend on the scale 
at which they are studied. It is therefore important to reformulate the ME taking into 
account its dependence on the size and time scales. Let us define two sets of scales: 

1. The size scales 6 = {6i, 6n), Si > 0, 

2. the time scale r > 0. 

Let us define the following lattice 



dP^{n,t) 
dt 



0(n)(P<x'(n,t)) + /CL(n)P.'(n,t) with a G S, (1) 




= {{niSi,...,nN5N) ■■ (ni, ...,nAr) e N } 



(2) 
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The state of the system is now specified on x S. The processes on will be 
birth-death interaction of the form 

(rei^i, ...riiSi, ...,71^6^) {niSi, ...,niSi ± Si, ...,71^5^), 
the processes on S are transitions 

a ^ a, 

driven by a finite Markov chain. Note that for fixed 6 a function / defined on is 

fully determined by its values on n, i.e. when 6 is fixed we can consider / defined over 
N^, writing f{n6) = /(n). Equation ([l]) is now rewritten in a form where C* and )C* 
are operators depending on 6 and r: 

r)P (n f) 

' = E CA^,r;n]{P^,{n,t))+Y, IClAS,r;n] P^,{n,t). (3) 

The continuum limit is the study of the form of C* and /C* as — > and r — > 0. 
Equation ([3| is defined on the space of probability measures on L_j- x S: 



p\ Yl P-H = ^ 



The continuum limit is naturally constructed on the dual of (see |27j). namely on 

< n : L^-x S ^ rI^I I sup |n^(n)| < oo I . 

The pairing between X*, and is 

{P,u)= Yl ^-(n)^-(n)- 

Using the duality, the ME defined on becomes the Kolmogorov equation 

^""g"'^^ = E ^.Alr;n]iu^,in,t)) + ^ /CL[^>; n] n.'(n, t), (4) 
cr'es o-'es 

where 

{£*P,u) = {P,£u), {IC^P,u) = {P,ICu). 



For any fixed 6 and r equation (|4| is an infinitesimal generator of a Markov process 
on X S. Now let (5„ and r„ two sequences of scales such that 

5n^0, r„ ^ 
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as n — > oo. Then we can define a sequence of spaces X„ = X? , X* = HZ , and a 
sequence of operators Cn,ICn acting on In j27j . a method is introduced to study 
the hmit of Cn,ICn as n — > oo. The idea is to look at Cn,ICn defined on X„ as an 
approximation of infinitesimal generators jC,IC defined on a suitable Banach space that, 
in most applications, is given by X = C''(M'^, M^). Following [27] we construct a sequence 
of projections 

and we state that a sequence Un G X„ approximates u G X if 

\\Vn{u) - UnWn ^ 0. 

This will be denoted by Un ~ u. In order to take into account the presence of 
the scales 5n and r^, we modify the criteria to approximate the limit of operators (in an 
adapted way different from [271 EH] ) • Iii fact a sequence of linear operators An '■ X„ X„ 
is now a function of 5n and t„, and in general we cannot expect some limit to exist for 
any choice of (5„ — > 0, r„ ^ 0. For this reason we say that the sequence of operator 
converges. An ~ A, if there exists 5n ^ 0, r„ — > 0, and A defined on X such that 

WAniVniu)) — Vn{A{u))\\n —>■ for all u in the domain of A, 

as n — > oo. It is important to note that the limit is now depending on the choice of 
the sequence of scales converging to 0. We shall show that in general operators may have 
pre-factors which characterise their limit behaviour. The typical case will be £„ ~ £ 
and JCn ~ ^}C, which yields the limit 

A = C + ^IC. (5) 

Here the constant e will in general be a function of 6n — > 0, r„ ^ 0, so depending on 
the scales. This approach determines the operator ^ that, for fixed e, is the infinitesimal 
generator of a process on x S. In many applications it turns out that e is an 
infinitesimal function in Sn 0,Tn — > and this leads very naturally to the study of the 
adiabatic approximation for the equation 

du(x,t) ^, , 

— ^=^(n(x,t)). (6) 

In the applications is often considered the adjoint equation, the Fokker Planck equa- 
tion (FPE) which corresponds directly to the ME. The FPE is defined on the dual of X* 
and reads 

dp{^,t) _ ^*(^)(^(^^,)) + i/C^(x)p(x,t). (7) 



dt ' ' " e 

and 



p : J dxp(x, (t)'u(x, cj) < cxD > 
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Adiabatic approximation 

The adiabatic approximation theory is based on the observation that for sufficiently 
smah e the dynamics of the finite state Markov chain is faster than the one of the birth- 
death process. This should be a reasonable assumption for most or all macro-molecular 
behaviour in a cell. Such an assumption implies that on sufficiently large time scales 
the Markov chain can be considered at equilibrium. Generalising [6] we assume that the 
Markov chain has possibly more than one stationary measure: 

M/c = {/i(x) G X*. : /C^(x)/i(x) = 0}. 
To avoid trivialities we assume that 



m/c = dim(M/c) < g. 

Any convex combination 

^='^0m /U^*^^ with ^ 6'm = 1 where 9m G 

m=l 771=1 

is in M]Q (see P] ) . Each such measure describes the possible asymptotic behaviour of the 
Markov chain which is in general decomposable, i.e. a product of mjQ Markov chains. 
We now take one convex combination ^ E M]q and construct the adiabatic theory for the 
FPE obtaining an asymptotic expansion in e of p. This expansion has a leading order 
term, which will be called average dynamics. This dynamics is given by 



dt 

m=l o-eS 



where 



/(x, t) = E z^-^^' ^it^ = {a G S : / 0} (9) 

is the marginal distribution associated to /i. It is noteworthy that the appearance of 
an averaged dynamics occurs in the modified Gillespie's algorithm as presented in j20j . 



Description in terms of ODEs and SDEs 

In the study of ([7]) for small e one could make the non-trivial observation that equation 
([7| up to order 0{e) generates a Markov process described by a stochastic differential 
equation. This observation which entails to show that ([7| up to 0(e) reduces to a 
parabolic operator will be clarified in another paper. It is important to mention here 
that such an approximation is valid only on finite time interval as it was shown in ^ , [9] 
and [10] . Under this restricted condition the dynamics can be described by the following 
Ito stochastic differential equation 
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N 

dxa{t) = Aaixit)) dt + ^/e'^aa|3{yi{t)) dw'^ with a = l,...,N, (10) 
where {w^}^^^ are A^-independent Wiener processes. Here ||cr(e,x)|| ~ ^/e and A(x) 



is the averaged vector field given by 



A,(x) = j;0„L^,(x)^f)(x). (11) 

Here -^^-'(x) is the deterministic vector field associated to the finite state j. Moreover 
A{x) is the average over the stationary measure /x(x) of all vector fields associated to 
the finite states in S. If m/c > 1 then the Markov chain is equivalent to a product of rri/c 



Markov chains and the vector- field (11) describes the deterministic dynamics averaged 



over all mjc components of S. We illustrate the theory using equation (11) and derive 
as applications effective reaction rates related to different macro-molecular machinery. 
One prominent example is the well known Hill's kinetics. In a forthcoming paper we 
apply this theory to derive rigourously the nonlinear macroscopic model used in [12] to 
study - on a more heuristic basis - the bistability in the Lac-Operon. 



The organisation of the paper is as follows. We first define systems with both infinite 
and finite degrees of freedom. Then we introduce formally the continuum approximation 
for our setting. Finally the adiabatic approximation is constructed. The second part of 
this series contains the examples, noteworthy a new approach to enzyme kinetics ([23 ). 
In the appendix we describe the geometrical structure of the Markov chain which is very 
important to develop the adiabatic theory. 



2 Systems with infinite and finite degrees of freedom 

As motivated in the introduction typical macro-molecular systems give rise to mixed 
microscopic dynamics, consisting of birth-death processes where particle or molecule 
numbers can be arbitrarily large, and a second part where some entities have a fixed 
number of molecules in the system, but each equipped with finitely many different func- 
tional states giving rise to a finite state Markov chain. 

The following definition will fix this structure for further investigation, followed by an 
illustrative and biologically important example. 

Definition 2.1. Let us define two sets of scales 

1. size scales 6 = {5i, 6]\f), Si > 0, 

2. time scale r > 0. 

Let L,g be the following lattice 

hg= {n6 = {ni5i,...,nNSN) : n = (ni, njv) G N^} (12) 
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Remark 2.1. On L,g we shall define functions, now for fixed 6 the value of any function 
u is uniquely determined by the integer vector n therefore whenever 5 is fixed we shall 
omit the 5 dependence and write n(n). 

Definition 2.2. Let the tuple {(^,R,P) determine a stochastic process by specifying the 
state a set of reactions R, and a vector of probabilities P, such that 

(i) the state ( of the system is fully specified 6y ni, njv infinite degrees of freedom 
(i.dl.) and a second variable, the finite degrees of freedom s (f.d.f.). The state C 
is therefore the composition 



C = (niJi, nN6N, 0-) = (n(5, a) eh^x S, 

where = (^N^, n is an n-tuple of natural numbers and a runs in a finite set S, 
with \T,\ = g being the number of discrete states. 

(a) the time evolution of the stochastic process is defined via the set of reactions R 
having three different types: 

(a) Processes involving only i.d.f. 's represented by reactions (possibly reversible) 
of the form 



(n,cj) (n ,ct). 



The operator describing these reactions in the master equation (I4) is denoted 
by C*^ and has the form £|j = ® Saa'j where Iq is the same operator for 
each discrete state a = 1, ...,g. Here = 1 for a = a' , and zero otherwise. 

(b) Processes involving only f.d.f. 's represented by reactions (possibly reversible) 
of the form 



fn, a) (n, a') 



The operator describing these reactions in the master equation (I4) is the 
transpose K?" of the Markov chain generator of the process governing the 
transitions among the discrete states a = 1, ...,5. The Markov chain is finite 
dimensional with a space of stationary states M]q of dimension strictly less 
than g. 

(c) Processes involving both i.d.f. and f.d.f. represented by reactions (possibly 
reversible ) of the form 



(n,cjj 



{to!, a). 



The operator describing these reactions in the master equation (I4) is denoted 
by C*^. This operator is non-trivial only in the discrete states a which affect 
processes involving i.d.f.. 
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jJt Ui^CaCf LCf ULLiaCLL 1,11 IL 

the vector of probabilities 



(Hi) each realisation of the process is valued in x S. The state C at time t is given by 



P{t,n) = {P^{t,n),...,Pg{t,n)), with n) = 1. (13) 

neN^ cr=l 

The time evolution of P is given by the master equation (ME) 
dP{t,n) 



dt 



(£Jj, + C*e) o P{t, n) + IC' (n) P{t, n), (14) 



P, C*^ and IC^ are sufficiently regular such that (I4) has a unique solution for 
all times t > 0. Then the tuple {C,R,P) is called a (microscopic) system with infinite 
and finite degrees of freedom, or short an IFSS (Infinite-Finite State System). 

Illustrative example of a typical IFSS: Single enzyme kinetics 

Consider a system with 2 i.d.f. and 1 f.d.f.. The system has state space {a,m,Oi) G 
((5N)^ X S, and will be described by the vector propbability 

P{t,m,a) = {Po{t,m,a), Pi{t,m,a)). 

Here a and m are the numbers of two small species of molecules (i.d.f.) called A and 
M, and S = {Oq, Oi} are the discrete states of a molecular machine (f.d.f.), for example 
an enzyme. Reactions of type (a) are those independent from the discrete states of the 
macro-molecular machinery. In our example we assume that degradation of M is of this 
type: 

M ^^/^ 

This reaction takes place at speed > 0. This gives the following contributions to 
the ME 

+ - (m + 1) Pa{t, m + l,a) m Pcr{t, m, a) for a = Oq, Oi. 

T T 

Such terms can be rewritten as 

-(E+ -id)(mP^(t,m,a)) 
r 

where E^ and id are difference operator defined as 

E+/(m) = /(m + 1), id/(?Ti) = f{m) for every f : 6N ^R. 
Using this difference operator notation C* is then given by 

^ ~ r I i/(E+-id)(m-) ) ' 
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Reactions of type (b) are given by 

A + Oo Oi, 

they describe the transitions of the discrete states of the macro-molecule, possibly 
depending on binding of smaller molecules, in this case of molecules of type A. Moreover 
the transition rates depend on the relative Markov chain 'switching' time scale r and the 
system size 5, which is defined as inverse of the largest average number of A molecules 
in the system. The generator of the Markov chain is then given by 

1 / —ak^ ak'^ \ 

~ ^ \ k- -k- J ' 

This also implies the time evolution of the system must be described through the 
vector probability 



P{t, m, a) = {PQ{t, m, a), Pi{t, m,a — 1)) ~ {Po{t, m, a),Pi{t, m, a)) 

for a much larger than 6. 

Finally the only reaction of type (c) is given by 

iD^v/r Mioi a = Oi, 

with Oi interpreted as the active state, the only one at which the enzyme in addition 
catalyses molecules of type M. This reaction gives the following contribution to the ME 

for s = Oo 

V V 

- Pi{t,m — 1 , a) Pi{t,m,a) for o = 0\. 

T T 

The second contribution can be rewritten as 

-(E~ — id)Pcr{t, m, a) for a = Oi and m> 1. 

T 

where E~ is the difference operator defined by 

E-(/(m)) = f{m - 1) for every f:5N^R. 
The operator C'^ is defined as 

-C " )■ 

T \ »(E--id)(.) ; 



r* — 



The ME can now be written as 

dP 



- jC*P + IC' P, 
at 
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where £* = £^ + C*^. This is the matrix form of 



dPnit, m,a) (m + 1) ^ , , um ^ , 

^ ' = — Po{t, m + 1, a) Po{t, m, a) + 

at T T 

-"^^^ PQ{t,m,a) + — Pi{t,m,a) 

T T 

^ ' ' ' = ^ ' Pi{t, m + 1, a) Pi{t, m, o) + 

at T T 

+ - Pi{t, m — 1, a) Pi{t, m, a) H Po{t, m,a) — k Pi{t, m, a) 

T T T 

This system wih be fuhy analysed in the second part, see |23j . The boundary conditions 
are the natural one at m = (see |EBJ and are give by 

dPQ(t,0,a) V ^ , . ak^ ^ , , k^ ^ , 

' = - Po{t, 1, a) Po{t, 0, a) + — Pi{t, 0, a) 

at T T T 

Pi (i, 0, a) I' „ , , ak^ „ , , „ , 

' = - Pi (t, 1 , a) + Po(t, 0,a)-k~ Pi{t,0,a) 

at T T 

3 Construction of the continuum approximation 

The ME results from the specification of the reactions at a given scales 6,t. The ME 
describes the evolution of a probability measure Pa{t; n) according to 



dP 

~dt 



A*[5,t]P, 



(15) 



where A*[S, r] is the infinitesimal generator defined on the scales S, r by 

A*[5,t] = C*[6,t] + IC'^[S,t]. 
The operator r] is defined on the space 



(16) 



P^{t; n) : ^ ^ Pa{t; n) = 1 for al t 



(17) 



Let us now consider a sequence of scales 6n, Tn such that 5n ^ and r„ — > as n — > oo. 
For each index n we have an operator An = A[6n, t„] defined on X* = X*. where the 
configuration space can now be denoted by L„ = L? . We ask ourselves what would the 

On 



fate of ( 16 ) be as n — > oo. 



We can think of ^ and Tn ^ as limit at which space and time step become 
continuous and the numbers of particles are sufficiently to be accounted as densities and 
this motivates the name continuum limit. 
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The formulation of the continuum hmit can be obtained by using the approximation 
scheme introduced by Trotter in [27J, (see also |19] . To introduce Trotter approach 

we first need to observe that to each defined on X* we can associate a vector space 
X„ and an adjoint operator An- The vector space is defined by 

X„ = X? = < Ucr(t, n) : L„ X S ^ : ||m||oo = sup n)| < oo, for al t > . 

[ n6Li,aeE J 

(18) 

Each X„ is dual to X* according to the pairing: 

{u,P)n= Yl M^)PA^)- (19) 

(n,(T)eL„xS 

The adjoint An is defined by: 

{AnU,P)n = {u,A*nP)n. (20) 

Let us consider 



u{t,n,a) = P{t, n,n' , a, a')u{n' , a') 



then to equation (15) we now associate 

du , , ^ 

-Ql=^nU, (21) 

defined on each X„. Here 

A = lim-(P* -id) (22) 

see [29| for all the details. 



For any index n equation (21) is the standard Kolmogorov and An is the infinitesimal 
generator of Markov process on L„ x S. The definition of the continuum limit is based 
on the choice a target space where the limit is attained. We shall consider as target the 
space of continuous function X = C'^(M^,M^). The topological dual of X is formed by 
signed measures on x S: 

X* = {/9(x) : (p, u) < oo, n G X} , (23) 

where the pairing is defined by 

{P:u) = Idx ^p<^(x)n^(x). 

•^^+ (res 

According to [27] we define a sequence of projections 

Definit ion 3.1. Let 'Pn '■ X i — > Xn be the opevator that tnaps u G ^ to T^n{u) G X^ 
defined as 

Vn{u)(k) = u(k5n) = u{ki6l,...,kNSn)- 
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The following holds true 
Proposition 3.1. The projections Vn satisfy the following properties 

(i) 1 1 "Pn 1 1 n ^ 1 ; 

(a) lim„^oo ||^n('u)||n = ||^i||oo for every ueX. 
Proof. Part (i) follows from: 

II \\'Pn{u)\\n 
\\Vn\\n = sup — — n 

uex IpIIoo 

and from 

\\'Pniu)\\n = sup ||n(k5„)|| < ||m||oo 
keL„ 

for L„ C L„+i. 

Let us now show (ii). We know that ||7^n('u)||n < 1 1 "^^ I loo- Since L„ C L„+i the following 
holds 

||^n(w)||„ < ||Pn+l(u)||„+i. 

therefore the sequence ||'Pn(^i)||n is increasing and as n ^ oo 

||^n('u)||n sup ||P„(ti)||n = ||li||oo- 
n 

□ 

Following ([27]) the projectors Vn allow to define in what sense the spaces X„ ap- 
proximate X. 

Definition 3.2. A sequence Un € X„ converges to u €li if 

W'Pniu) — UnWn — *■ OS n — > OO. 

We denote this by Un ^ u. 

Remark 3.1. Condition (ii) on Vn guarantees that the limit ~ is unique. In fact if 
Un ^ u and Un ~ u' then by (ii) we can estimate 

ll^i - -u'lloo = lim \\Vniu - u)\\n < hm ||P„(u) - n„|| + lim \\Vn{u) - Un\\n 
n— *oo n— >oo n—>oo 

which of course goes to as n —> oo. 

We now give the definition for the limit, in fact the continuum limit, of a sequence 
of operators An- This definition is inspired by the one presented in [27j. In fact in the 
present case we have to consider that the operators are functions of the scales Sn and 
Tn- Therefore we set 
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Definition 3.3. Let An '■ X„ ^ X„ be a sequence of linear operators. We say that 
A-.Hh^li is the continuum limit of An (denoted by An ^ A) if there exists a sequence 
of scales 6n,Tn such that 

1. 5n 0, Tn ^ 0, 

2. the domain of A is 

D{A) = {n G X : Vn{u) G D{An), An{Vn{u)) converges}, 



3. and \\Vn{A{u)) - An{Vn{u))\\n -^^ asn^oo. 

Remark 3.2. The dependence on the choice of the scales 5n andTn makes the continuum 
limit non unique. This is very important because with the choice of the scaling we will 
be able to analyse different type of processes. 

duality 



Master Equation Kolmogorov Equation 



Continuum 
Limit 



duality 



Fokkcr-Planck Equation 



Kolmogorov Equation 



Figure 2: A schematic view of the Continuum Limit 



In what follows we shall construct examples A^ that correspond to Master Equations 
on X* . Via the duality we derive the infinitesimal generator An i-e. the Kolmogorv 
equation on X„. At that point we study the continuum limit of An and finally via 
the duality between X* and X we derive the Fokker-Planck equation on X*. This is 
illustrated in Figure [2] 



3.1 Examples 

In this section we illustrate the theory by studying the continuum limit of some crucial 
examples that will be used in the applications to reaction networks. 
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3.1.1 Difference operator 



Let L„ = (5„ Z and X* be the space of probability distribution on L„ and X = 
Consider the following operator 

A;(P)(fc) = -(E+ - id)(a„P)(fe) = -[anik + l)P(fc + 1) - a„(A;)P(A;)] 



The adjoint A„ is defined by 



A simple calculation shows that 



(E- - id). 



We now compute the continuum limit. Let a G X such that Vn{a){kSn) = a{kSn) 
an{k). Let (5„,r„ such that 



Then 



J„ — s- 0, r„ — with >c>Oasn— >-oo. 



A„ —ca(x)A., where A = — — . 

ox 



In fact consider take u G C^(M,M) C 

\\An{Vn{u))-Vn{A{umn 

This can be rewritten as 

an{k) 5n ( u{{k - 1) Sn) - u{k Sn) 



an{k) 
a{kSn 



u{{k- l)Sn) -u{kdn] 



u{{k - 1) 5n) - u{k5n) 



"^i^- -\d)u{k5n) + ca{k5n)^{k5n) 



+ ca{k6n)-^{k5n) 



Sn 



+ ca{kSn) ^^^^j,^^~^^ <ik-l)5n)^-u{k5n) 



The last term is bounded by 

Sn 



< 



a{kSn) 

Sn 



sup \ a{k Sn) \ sup 

k k 



u{{k - 1) Sn) - u{k6r. 

Sn 

u{{k - 1) 6n) - u{kSn 

Sn 



+ ca{kSn) ( Q^i^^n) + 



< 



+ csup \ a{k 5n) \ sup 

k k 



u{{k - 1) Sn) - u{k5n)^ 

Sn 

du u{{k - 1) dn) - u{k Sr 

[k Sn) + ^ 



dx 



Now as n — > oo 



0, 
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sup^j \a{k6n)\ is bounded, the term 
u{{k - l)Sn) - u{kSn 



sup 

k 

For the term 



1 

sup — 

k On 



, uix) 
ax 

{k-l)Sn 



dx 



< 



u{x) 



dx 



sup 
k 



+ Sn 



we use 



to obtain 



sup 
k 



u{y) = u{x) + u' {x){y - x) + / ds{s - x) 



Wx^^^-^^ 5n 



sup 

k 



< \\u"\ 



1 



{k-l)Sn 

kSn 



oo^SUp 
On k 



{k-l)Sn 



ds{s — k 5n) 



< 



^11 //II r> 

< \\u Woo ^ U as n — ^ oo. 

- II lioo 2 



We therefore conclude An ~ .4. A simple integration by parts shows that 

d 

A*(p)(a;) = ^(ca(x) p{x)) for all p G X*. 
3.1.2 Multiplication operator 

Let Kn = lC^^^T-^{Ta) be defined on X„. We want to find /C is a matrix operator acting by 
multiplication on X such that 

||/C„(n.(n)) - Vn{ny))\\n ^0 Vn G X. 
This condition holds if we take /C(x) = ^ /C(x) such that 



^<5„,r„(n)w(k5„) - -lC{u{\i8n))) 



where e is chosen so that the limits holds. 
Let us consider the following example 



VuGX, 



-mk'^{5n,Tn) mk~^{6n,Tn) 



We seek the continuum limit in the form 

1 / —xk'^ xk'^ 



k- 



-k- 
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with positive constants. Now in order to construct the expression 

||/C„Pn(u)-Pn(/C(u))|U 

we compute 

1 f -mk-^{Sn,Tn){ui{m5n) - Ui{m5n)) 
lCn{Vn{u))(rn) = — 

Tn \ k {dn,Tn){ui{mSn) - Ui{m6n)) 

and 

1 / -mdnk~^{5n,Tn){ui{mSn) - Ul{m.Sn)) 



Therefore we can have 

hm \\ICnVn{u)-VniJC{u))\\n=0 
n— »oo 

for all u G X if the following relations hold 

^nk^ k'^i^njTn) k k ((5jj,T„) 

e r„ ' e Tn ' 

These relations have to satisfy the compatibility condition 

Snk'^ k~^{6n,Tn) 

k k {Sn,Tn) 

Here we see that if 

k^{Sn,Tn) = 6nk'^, k ((5^,T„) = k 

then the limit exits for e = Tn which is infinitesimal for large n. 

Remark 3.3. The choice of e as a function of of the scales Sn,Tn is essentially a form 
a form of renormalisation of the time scales associated to respectively the infinitesimal 
generator C and /C. 

3.1.3 DifFusion operator 

WE consider the one dimensional case L„ = 5^^. Let us consider the operator 

An = -[an{k)A- + bn{k)A+] (24) 

Tn 

We now take o, 6 G X such that Vnia) = a„ and Vn{b) = bn- In order to construct a 
continuum limit we compute 

AniPniu)) = —anA-{u) + — 6„A+(u) = 
Tn Tn 

= ^I^[u{{k - l)6n) - U{k6n)] + ^K(A; + l)6n) - U{k5n)]. 
Tn Tn 
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We now re-write this operator using u £ 



using: 



u{y) = u{x) + u'{x){y - x) + ^^^-^^u"{x) + ^ £ ds{ 



S — X) 



We have 



AniPniu)) = 



an{k) 



Tn 



du{k8n) , 5ld'^u{k6n) 



dx 



an{k) 



r"(fe-l)<5„ 

ds{s - k5nf- „ 3 
this form can be rewritten as 



2 dx"^ 
+ 



bn{k) 



■ du{k6n) , 6ld'^u{k5n) 

On 7^ h 



ds{s - k5nf a \ + -iH- / ds(s-M„^2 \) 



6r, 



n JkS, 



dx ' 2 

' 



+ 



^ ^ (^n(6n(fc) - an(fc)) ^ + an(fc)) ^ 



5x 



2Tn 



dx"^ 



an{k) 



n Jk 



(fc-l)5n 



- + I ds{s - kSnf-Q^: 



6-rn JkSn 7jk5„ 

Now we need to guess a suitable operator A. Here we take 



A = a{x)- + P{x)—^ 



with a, /3 G X. Therefore 



dx 



dx"^ 



If we set (^^/rn ^ 1 and 



- -{hn{k) - an{k))\\n = o{l/n), \\(3{k5n) - ^{bn{k) + an{k))\\n = o(l/n) 



tlien 
where 

R{Sn, Tn 



\\An{Vn{u)) - rn{A{u))\\n < o(l/n)(||u'||oo + ||n"||oo) + \\R{Sn,Tn 



anjk) r^^- 

6Tn JkS„ 



(fc-l)5„ 



ds{s — kdn 



+ 



M f 

n J(l 



6Tn J{k+l)Sn 



ds{s — k6n) 



Now we can estimate 

msn, Tn)\\n ^ ||<^n"l"^n||n 



53 



sup 



6Tn k 



lik-l-kf+^ik+l-kf 



^ ||oSn"l"^n||n 



SI 

00 



Note that |[a„ + fe„, |[„ ||ct + /3||oo and thus have ||^(^n)7"n)||n ^ as n ^ 00 . 

Also in this case using the paring between X and X* we can show by an integration by 

parts that 

d cP' 
A\p{x)) = - — {a{x)p{x)) + -^{(5{x)p{x)) 

for aU pe X*. 
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3.2 Formulation of the multi-scale analysis 

We call a multiscale analysis the combination of continuum approximation and an adia- 
batic approximation for the ME of an IFSS. We construct the continuum approximation 
of the birth-death processes describing the small molecules first and will get a Fokker- 
Planck equation (FPE). Next we study the adiabatic approximation of the Markov chain, 
ending the multi-scale analysis. 

3.2.1 Continuum limit of the ME 

Definition 3.4 (Continuum approximation). Consider the infinitesimal generator as- 
sociated to ME of an IFSS given by 

= £[6, r](n)n(n, t) + IC[5, r](n) n(n, t), (25) 



defined on X?. We say that (25) admits as continuum limit 



= £(x)n(x, t) + -^ /C(x) n(x, t) , (26) 
defined on X if there exist a choice of the scaling (5„ — > 0, Tn ^ as n —> cxd such that 

(i) Cn = C[5n,Tn] ~ C, 

(a) JCn = }C[6n,Tn] ^ /C for somc choice of e. 

^^^""'^^ -^*(x)p(x,r) + iif^(x)p(x,r). (27) 



dr 



€ 



Remark 3.4. Clearly equation (21) depends on the scales Sn,Tn through the parameter 
e. 

Illustrative example: continuum limit 

In the illustrative example from enzyme kinetics the matrix C* is 

I ( um{E- -id){-) \ 

C = Ce + Cr = - \ 

r \ i/m(E- -id)(-) +v(E+ -id)(-) / 

and 

I / —ak~^ ak~^ \ 
T-\ k- -k- J ' 
Assuming that we can find e = e{S, r) such that 

{6u{6,t)/t) = u, {6v{6,t)/t) = v, {ak+{5,T)/T) = {a5k+)/e, {k~ {6,t) /t) = k' /e. 
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Taking e{5, t) = t with 5/t ^ 1, by recalling section 3.1.1 we obtain 

/ -z.xA(.) \ 

\ -{iyx-v)A{-) J ' 

where x is the concentration associated to m and 

I / —ak^ ak^ \ 
e\k- -k- J ' 
The continuum limit provides the construction of the infinitesimal operator A 

A{yi) = £(x) + ^ /C(x) 

density defined in X and the associated Kolmogorov equation 

9m(x, t) 



dt 



^(x) u(x,t). (28) 



For this equation there is an adjoint formulation. This is the FPE that is the dynamics 
read on the the space of probability measures X* . The FPE is 



where A* is the adjoint of A 



^^=X(x)p(x,t), (29) 



1* = £*(x) + ^/C^(x). 
e 



In most of the application the interests is concentrated on the the FPE. For this reason, 
in the next section we shall study the adiahatic limit for (29). The dynamics on X is 
related to the dynamics on X* by the following the following result (see [3 |29] ) : 

Theorem 3.1. Let\ be the Banach space of continuous functions from 'K'^ to (M^, (•,.))• 
For e > fixed, assume 

(i) C{x) has a dense domain in X and 

||(£(x) + a)-i|| < - Va>0, 
a 

where \\.\\\ is the standard norm on the space of linear operators in C'^(M:'^,M^). 

(a) /C(x) is a g X g matrix with bounded entries, and also the infinitesimal generator 
of a g- dimensional Markov chain. 
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Then equation 



= £(x)(n(x,t)) + ^/C(x)u(x,t) (30) 

admits a solution 'u(x, t), and the operator >C(x) + ^ /C(x) generates a Markov process on 
X S whose distribution p{^,t) satisfies equation (29). 



As we have seen in the example e is smah, therefore FPE (29) for p is singular 
at e = 0. For this reason we shall consider a perturbation analysis by means of an 
asymptotic series in e in the spirit of ^B] • This will require a time-scale analysis of the 
FPE which is called adiabatic approximation. We will need the following definitions: 

Definition 3.5. Let U be an open and bounded set in M^, T > 0, and let C^'* be the 
Banach space of functions from U x [0, T] C x M to which are r-times continuously 
differentiable w.r.t. x G [/ C and s-times continuously differentiable w.r.t. t € 
[0, T] C M. 

We need to recall the definition of asymptotic series: 
Definition 3.6 (Asymptotic series). Let Ve{x,t) be the formal power series 



,(x,t) = ^r;W(x,t) 



k=0 

Then we say converges asymptotically to vq for small e > if its partial sum 



vT{^,t) = yy\^,t)e' 

is such that 



k=0 



sup ||C(x,i)-^;.(x,t)|| <C7(C/,r)e-+i 
xeC/ciR'^,ie[o,T] 



for some C{U, T) > 0. 



4 Adiabatic theory 

In this section we construct the solution of the FPE generated by an IFSS by means 
of asymptotic expansions. Only the respective result for the Kolmogorov equation will 
be stated. This choice is not generic from a purely mathematical point of view as a 
solution of the FPE will the require more regularity conditions. Nevertheless the study 
of the FPE with smooth coefficients and smooth initial data is very relevant in many 
applications, motivating the subsequent presentation. 
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4.1 Formulation of the adiabatic problem 

An IFSS has by necessity two time scales after taking the continuum hmit. One is 
characterising the dynamics of the continuous degrees of freedom and the other one 
characterising the evolution of the finite state Markov chain. These time scales are 
associated to the following semi-groups: 

(i) exp(t£(x)), the semigroup generated by iC(x), 

(ii) exp((t/e) /C(x)), which is the semigroup generated by /C(x), the Markov chain 
generator. 

On a time scale of order 0(e) the Markov chain dynamics should prevail. Without loss 
of generality we can assume that the Markov chain has at least one invariant measure, 
and possibly a convex combination of stationary measures. Therefore on long time scales 
one expects that the Markov chain reaches an equilibrium very fast and the dynamics 
should essentially be given by the flow associated to >C(x). 



4.1.1 Diffusive and deterministic operators 

The operators -C(x) and £*(x) are differential operators which we investigate in the 
following, especially giving more details of their structure. The operator >C*(x) is a 
diagonal matrix with operator entries. Each non-degenerate nonzero entry is a second 
order linear parabolic operator. 

Definition 4.1 (Structure of C*). Let 

r (x) = £i(x) + £2(x) = 6ij (fl(x) + £|(x)) 
Let each of these operators >C (x) and >C (x) be given by 

>Cl(x)(/) = i:^(i^^a(x)/(x)), 

a 

and 

1 ^ rf 
oc,l3 ^ 

for f being a sufficiently smooth function. Then -C*(x) is called a regular Fokker- 
Planck operator. 

If C = 0, the operator C* becomes first order (i.e. non-regular) and describes 
the transport in the deterministic dynamics of i.d.fs. We can therefore identify two 

important regimes: With £^ 7^ we have diffusive f.d./.'s, and with €? = the i.d.f.^s 
are deterministic. The second possibility will be treated in part II of this paper series. 
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4.1.2 Main assumptions 

In order to simplify the further analysis we make the following assumption: 

(A) The Markov chain on S has a set of stationary measures M/c with dim(Myc) < g. 
Each measure /i(x) is C°° on M^. 

The next two assumptions give the explicit conditions for constructing the solution, 
respectively for the FPE and the Kolmogorov equation. 

(B) For a given ^(x) G Cic, the Cauchy problem 

aj(x,t) = (l^,r(x)(/x(x)/(x,t)))+F(x,t), /(x,0)GC^'^ (31) 

with F G C^'^ admits a solution which is C'* w.r.t. x and t G [0, Tq] C [0, T] for 
any smooth initial data. 

(C) For a given ^(x) G Cic, the Cauchy problem 

dtH^, t) = (^(x), £(x)(l^ ,^(x, t))) + G(x, t), 0(x, 0) G C"^'^ (32) 

with G G C"■'^ admits a solution which is w.r.t. x and t G [OjTq] C [0,r] for 
any smooth initial data. 

Remark 4.1. In applications we have that the operators 

(l,„£*(x)(^(x).)) and (/.(x), £(x)(l^ •)) 

are either parabolic or first order. In the parabolic case note that there is a general result 
(see lIEi), which guarantees that if the differential operator has C°° coefficients and the 
initial condition is also C°° then the solution is C^'2([0, T] x M^) n C°°([0, T) x M^) for 
some T > 0. 

Remark 4.2. In condions (B) and (C) respectively the intervals [0,To] and [0,Tq] are 
the maximal time intervals where each solution exists. Note that since solution of (B) 
implies (C), if (B) holds true then Tq = Tq. 

4.2 Main results 

We now state and prove the main results of the adiabatic theory for IFSS. Theorem 



4.1 is based on an elaboration of a respective proof presented in and clarifies the 



construction presented in 0. 



Theorem 4.1. For fixed /x G Cjc and under assumptions (A) and (B), equation (29) 
admits an asymptotic solution in each set of concentrated measures (see definition 
53. 
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Proof. We start with a few remarks. In the appendix we describe the geometry associated 
to the Markov chain and in particular to the kernel of /C"^ (see section 5.1). Note any 
initial data in evolve asymptotically to fi. Next we like to solve the equation 



^^^=£(p(x,t)) + i/C(x)/,(x,t) 
ot e 



(33) 



by using an asymptotic expansion and conditions (A), (B). Fix /u G C/c and take an initial 
condition in I^. Let m* be an integer to be determined later. We take the expansion 



,(x,t)=^6-p(-)(x,t). 



m=0 



To determine p^"^\x, t) we substitute the expansion for into equation (33) and collect 
the different orders in e. We obtain a hierarchy of equations 



0(l/e): /C^(x)p(0)(x,t) =0 

0(1) : ^^^^ -£*(/.(") (x,t)) =^W^)(x,t) 



dt 



0{e) : ^^5^ -r(,W(x,i)) = ^^(x)p(^)(x,t) 
Note that in the construction of the probability density p^ with its necessary normalisa- 



tion is not yet fixed. The equation (33) is linear in p^. Therefore the condition 



/ dxtr (p,(x,t)) = 1 



must be imposed on the final form of the expansion. Conditions (A) and (B) guarantee 
the possibility of solving the first two equations in above hierarchy. Indeed condition 
(A) implies that the equation 



/C^(x)p(o)(x,t) =0 



admits a solution of the form 



pW(x,t) = /W(x,t);.(x) 



(0)/ 



The second equation becomes 

a/i(x) /(°)(x,t) 

dt 



r(/x(x)/W(x,t))=/C^(x)/,«(x,t). 



(34) 
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By the Fredohlm alternative theorem (see [TBI) we have that a necessary condition for 



solving (34) is that the l.h.s. is orthogonal to the kernel of /C(x) (see [18 ). Condition 



(A) implies that 1^ satisfies 



/C(x) 1^ = 0. 



Therefore 



^^^^ aMx)/(°)(x,t) _^,^^^^^^(0)^^^^^A ^ ^i^^^T(^)^(l)(^^i)) = (/C(x)l^,p«(x,t)) =0. 



To determine a solution one needs to solve 

|((l^,Mx))/(0)(x,t)) - (l^,£*(x)(/.(x)/W(x,t))) = 0, 
which is equal to equation ( |31[ ) upon noting the condition 

(i^,Mx)) = i. 

To proceed further we compute p^^\'x.,t). Note that any p as a vector in can be 
decomposed by projection 11^ (see section 5.1). Let /9^"^(x, t) be the nth term of the 
expansion 



(x,t) = n^(pW(x,0) + (i^ - n^)(pW(x,t)) = e('^)(x,t) + /W(x,t)Mx). 



Using that = (/C^)^ /C^(x), we have 



n^(p«(x,0) = (/C^)% 



9p(°)(x, t) 



dt 



r(p(o)(x,t)) 



Since p''°\x,t) = f^^\x,t) /i(x) and (/C^)^/i(x) = we get 

^«(x,t) = n^(p«(x,t)) = -(/C^)%£(/x(x)/W(x,t)). 
To construct pi{x,t) we also need that 

(I^-n^)(p«(x,t)) = (l,pW(x,t)) = Mx)/«(x,t). 



Like for p^^^ we obtain 



^^^^-r(p«(x,t)) = x;^(x)p(^)(x,t), 



which can be projected on 1^ leading to 

0/(1) (x,t) 



9t 



(i^,r(p(i)(x,t))) = o. 



26 



Using the fact that 



p«(x,t) = e(^)(x,t)+/.(x) /W(x,t) = -(/C;^)%£*(Mx)/(o)(x,t))+/i(x)/W(x,t), 
the equation for /^^^ becomes 

' - (iM,r(Mx)/(^^(x,t)) + r((/c^)%r(^(x)/W(x,t)))) = 0. 

The argument can be iterated. Therefore the term p^'^\x, t) is determined by computing 
its projections 

e(")(x,t): n>W(x,t))=e(")(x,t) 

/W(x,t) : (I^-n^)(p(")(x,t)) =/x(x)/(")(x,t). 

Let us assume we know p^'^^ from /c = up to n — 1. Then is obtained by projecting 
the equation 



dt 



£*(p("-i)(x,t))=/C^(x)/,W(x,t), 



namely 



^(")(x,t) = n>W(x,t)) = (/c^)% 



dt 



r(/,(""i)(x,t)) 



The term Z^"-* is determined by projecting the equation 



^^^^ - r(p(")(x,t)) = ^^(x)p("+y(x,t), 

and therefore /^"^ solves 

^^^gf'^^ - (l;.,r(Mx)/(")(x,t)) + (x,t))) = 0. 

This concludes the construction of the expansion. 



(35) 



(36) 



We now prove that the expansion of p converges asymptotically. We extend a similar 
argument presented in p!8]. We show that condition (B) allows us to evaluate the 
regularity of the asymptotic expansion. Recall that for n = 



r e(°Hx,t) = o 

a/(°)(x,t) 



dt 



(l^,£*(Mx)/(°)(x,t))) 



(37) 
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holds. Also for n > 1 we have 



e(")(x,t) = (/c^)% 

a/(")(x,t) 



dt 



r(e("-^)(x,t) + /.(x)/(-i)(x,t)) 



(38) 



dt 



(i„ r (a.(x) /W(x, t))) + {i„ r (c(")(x, t))). 



Observe that i), i) £ C""'**, therefore equations (38 ) and condition (B) imply that 
j(n)^^(n) ^ (-,r-2,s-i_ rpj^^ golution of (g defines the map 



as follows: 



M/(e("-^)(x,t) + ^(x)/^"-^^(x,t)) = e^"^(x,t) + Mx)/^"^(x,t). 



f(n-l) 



P(")f 



Now for n = condition (B) implies (37) has a solution. Any initial condition in C" 
yields /("•'(x, t) G C'''. Using the map \I' we can write 



pW(x,t)=M/"(Mx)/^^^(x,t) 



(0)/ 



with 



p(")(x,t) G C'^-2«.«-« for < n < m*. 
Let us now fix the order of the asymptotic expansion to be 

r - 2 



m = mm 



.8 + 1} , 



so that e C^'i. Write as 

m* 

/,,(x,t) = ^eV=)(x,t) + i?(x,t), 

fc=0 

where i?(x, t) is the error term. Using the equation for we derive an equation for this 
error term: 



k=0 ^ ^ \fc=0 / 

Now using the equations for p^''^ for 1 < /c < m* , we obtain 
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where 



= + 1/C'^(x). 

The operator C* is a generator of a contraction semigroup for t G [0,ro). Therefore 
can use its exponential to compute i?(x, t), with 



i?(x, t) = exp it £*) i?(x, 0)+ 

+6"^* J^dsexp{{t-s)C:) ^£*(p(™*)(x,s)) - 



ds 



Using the semigroup property the norm of exp{tC*) can be bound by 



sup II exp(t >C£)|| = 1. 
xen,te[o,To] 



This imphes the estimate 



sup ||i?(x,t)|| < sup ||i?(x,0)|| + e""" / ds sup C* {p^^^'^x, s)) - ^ ^ ' 

x,te[0,To] X Jo x,s OS 

Since m* = (r — 2)/2 we have that 

r(p(-*)(x,.))- ^^^'"2^"'^^ GC°--', 
with s' > 0. Therefore there exists Ci(n,ro) > such that 

sup ||i?(x,t)|| <sup||ii(x,0)||+e™*roCi(0,ro). 
xen,t6[o,To] X 

Taking an initial condition satisfying 

sup ||i?(x,0)|| = C2(0,ro)e'"*, 

xeQ,t6[0,To] 

the final estimation on the error is given by 

sup \\R{^,t)\\<e"-''{C2{n,To) + ToCi{n,To)). 
xen,te[o,ro] 

Thus we get the estimate 

sup ||p(x,i)-p(-*-i)(x,t)|| <e-*(C2(Jl,To) + roCi(Jl,ro)). 
x6n,te[o,ro] 

This concludes the proof. 
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In case condition (B) does not hold the operator (1^, £*/i(x)-) does not yield a probability 
density which is sufficiently smooth. In such circumstances one can look at a weaker 
hypothesis such as condition (C). 



Theorem 4.2. For fixed fi G Cjc and under assumptions (A), (C), equation (30) admits 
an asymptotic solution in the set of concentrated functions y^. This solution gives rise 



to a solution for the Kolmogorov equation and therefore to a weak solution for (29) 
Proof. The aim is to construct an asymptotic solution for 

= £(x)(n(x, i)) + ^ /C(x) u{-K, t). 
In the following we only outline the proof of theorem |4.2| The method used is close to 



(39) 



the proof of theorem 4.1 In summary we have the following steps: 

1. Fix /X E Cyc and consider initial conditions in 3^^. 

2. Consider an expansion of the form: ^^(x, t) = X^^^g e" ii("'^(x, t). 

3. Construct the equation at each order k. 

4. Decompose each 'u^"^(x, t) using the projection vr^ 



n(")(x,t)=r?W(x,t) + 1^0(")(x,t), 



where 



r?(-)(x,t) =7r^(tx(")(x,t)), 0(")(x,t) = (1^, n(")(x, t)). 
5. Construct the hierarchy of equations. For n = we have 

r r/(°)(x,t) =0 



a(/.(o)(x,t) 

dt 



(/z(x),£(1^0(o)(x,t))) 



Then for n > 1 we get 



(40) 



77W(x,t)=/C^I, 



5r/("-^)(x,t) 
dt 



£(7?("-i)(x,t) + l, 



(n-1). 



X,t)) 



= (Mx),£(1^0(")(x,t))) + (/.(x),£(,?W(x,t))). 



(41) 



6. The evaluation of the remainder of the asymptotic series is then carried out in the 



same way as in theorem 4.1 
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□ 



Remark 4.3. It is worth to mention that in systems where C*^ is not identically zero 
and therefore C* is not diagonal the higher order corrections play a crucial role. In 
fact there exist systems with different £* operator but same average dynamics. For such 
systems it is necessary to study also the higher order terms in the e-expansion. This 
class of system will he investigated in a forthcoming paper. 

Illustrative example: adiabatic theory and average dynamics 

We illustrate the theory by looking finally at the example from enzyme kinetics following 
the introduction of an IFSS. We have now obtained two different macroscopic limits 
due to the nature of the IFSS, in sequential order, first the continuum limit, then the 
adiabatic limit. The result is 



< 




^(")(x,t) = (/C^)% 



(42) 



where the invariant measure is 



k- + ak+ 
ak+ 



\ k- + ak+ I 



The matrix id the identity in and 



Furthermore L* becomes 




and the infnitesimal generator has the form 




Finally the Drazin inverse is 
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{ak+ + k-)^ 



1 



( 



a —k 



ak^ k 



) 



Remark 4.4. The solution of produces the expansion of the probability distribution 
P{t,x,a). It is useful to observe that the first two terms of the expansions of ^ and f 
are given by 



generate the a diffusion process whose diffusion coefficient depend on e and 5 and 
therefore the time evolution of the concentration x will be dictated by a stochastic differ- 
ential equation. The construction of this approximation will the subject of a forthcoming 
paper and is not further considered here. 

The above example will be used to derive the Michaelis-Menten and Hill type kinetics 
known from enzyme kinetics (but also often used in genetics) as a deterministic limit of 
the probability distribution P. 

5 Appendix 

In this appendix we collect the main property of the geometrical property associated to 
the Markov chain generator /C. 

5.1 Geometry of the Markov chain 

The adiabatic approximation can be carried out by taking advantage of the geometrical 
structure associated to the Markov chain, i.e. the occurence of multiple stationary 
measures. This will be highly relevant in applications where different parts of the Markov 
chain will be associated to different distinct molecular machines which will be able 
to exist in different modes of operation. Such a structure will be preserved by the 
continuum approximation leading to the most important tool to construct the adiabatic 
approximation of the FPE. For the construction the following definition is of importance: 

Definition 5.1 (Drazin inverse). Let ^ : i-^ be a linear map with ker(A) ^ 0. 
The Drazin inverse of A is a linear map defined as 



< 




UaGa f/. 



r-l 
A ' 
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where 

(i) Ga is a diagonal matrix with: 

iGA)ii = CLi if ai is a non-zero eigenvalue of A, and 
{GA)ii = for a eigenvalue of A. 

(a) Ua is the matrix whose columns are the eigenvectors of A. 

The Drazin inverse satisfies the fohowing proposition: 
Proposition 5.1. If v & ker(A) then v G ker(j4^). 

Proof. Indeed since f is a column on Ua we have that UJ^ v is a vector with all 
zero entries but one corresponding to v in Ua- Therefore the definition of Ga implies 
GaUX^ v = 0. □ 

The matrix /C(x) is an infinitesimal generator of a finite Markov chain for every 
X G M^, whose transpose is /C'^(x). Both /C(x) and /C"^(x) are linear operators acting on 
(.,.)). The geometric structure we are interested in is based on stationary measures: 
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Definition 5.2 (Stationary measures). 



Mic = \ ;u(x) : /C^(x)^(x) = 0, ^ /ii(x) = 1 



1=1 



We make the following assumption: 
(*) dim(ker(/C-^(x)) < g uniformly in x. 



A trivial consequence of the definition 5.2 and assuption (*) is: 

Proposition 5.2. Mj^ is a linear subspace o/ and mtc = dim(Mx:) = ker(/C"^(x)). 
Let {9i}i he a sequence of real numbers such that Om = ^- Then the vector 



m=l 



where /i^™) G Mjc- 



This motivates the next definition considering convex combinations of stationary mea- 
sures: 

Definition 5.3 (Convex combinations). We denote by 

/i G M/c : M = with Y,0m = l, O^GR+\. 

m=l m=l ) 

the set of convex combinations of stationary measures if an IFSS. 
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A normalisation of the combination fi can be written as 

9 



(l^.,^(x)) = tr (^(n)) = ^/ife(x) = 1. 



k=l 

In this context it is useful to make an additional definition. First let us introduce 1^ G 



is given by 



if = 

1 if / 0, 



then we define 

Definition 5.4 (Concentrated measures). Let n £ Cic- Let 

2"/. = |p : (pW) = 1 and ^(1^, p(x)) = l| . 

We call the set of concentrated measures. 

Remark 5.1. Note that the set contains all probability distributions which have the 
same support as the chosen convex combination of stationary measures /i. 

Now the vector of probabilities can be decomposed in the following way: 

Proposition 5.3. Given fi G C/c, let P G M^. Then P can be decomposed into 

p(x)=e(x)+/(x)/i(x), 

where 

C(x)=n^(p(x)), /(x,t)= l^p(n). 
The function /(x) is called marginal distribution. 
Proof. Let us define the operator 

where is a diagonal matrix such that {ifj.)aa' = 1 if and only if /io- 7^ otherwise 
{^fj,)aa' = 0. One can easily verify that 

= 

From this relation the decomposition of p(x) follows. □ 

The matrix /C-^(x) cannot be inverted because ker(/C^(x)) / 0. Here we need to use the 
Drazin inverse. The following result holds true (see |22j): 
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(43) 



Proof. From proposition (5.1) follows 



This proves the first relation of (|43|). For the second relation the reader is refered to 



As the matrix /C(x) is the transpose of /C'^(x) we will show that i^(x) provides a splitting 
of maps from to M^. More generally we shall now describe how to decompose any 
map $ : i— > M^. This decomposition will be useful to study the weak form of the FPE. 
In order to formulate the decomposition we first observe the following simple implication 
of assumption (★) : 

Proposition 5.5. ker(/C(n)) is generated by {l^j^gM^- 
Using proposition |5.5| one can show that 

Proposition 5.6. Every ^ : can be decomposed into 




□ 



^>(x) = r/(x) + (/)(x) 1 



where 



r?(n) = ^^($(x)) 



</)(x) = l/$(x). 



Proof. Let us define: 




Note that 



.2 



These relations imply that the decomposition holds true. 



□ 




(44) 



□ 
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Illustrative example: Invariant measure and Drazin inverse 

In our illustrative example from enzyme kinetics the MC has infinitesimal generator /C5. 
Its transpose is 



—a k 
ak'^ —k~ 

The invariant measure n that satisfies K.^fi = is 

k- + ak+ 
ak^ 



V k- + ak+ I 
Now the matrices C/jc and are respectively 

_i j = I - 

Now 

/ 

V ^ ajk++fe- 

so the Drazin inverse {K7)^ = C//c Gyc ^^yc^ 



ak++k- ak++kj 



1 



T D 1 f -ak+ k- \ 

^ = {ak+ + k-r [ ak+ -k- ) ■ 
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